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Evaluation in Guidance (NEAMEG) Conference 
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discussion of vital issues related to mea 
facilitate communication among educators 
levels of education within the New England 
their active involvement in "attacking" 
and concerns relating to the use of tests 
devices; and (3) stimulate the development 
papers stating the views of the professional 
a group, which may serve as guidelines 
include: “Innovative Test Usage for Individual Pupil Growth," Philip 
I. Clark; “National Assessment," Thomas R • Knapp; "State Testing 
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Burns; "Federally Funded Programs," Thomas Burns; "Disclosure of Test 
Results," Thomas P. Nally; "Norms: Fact or Fancy," Walter N* Durost; 

"Tests: Who or What is Being Evaluated," C. Thomas 

Jensen Report," Paul B. Campbell* A summary of the 
reactors to each presentation follows each paper. 
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FOREWORD: 

MEASUREMENT - SOME IMPLICATIONS FOR THE 70's? 



By EILEEN A. MATTEO 

Consultant, Elementary Guidance 

Rhode Island State Agency for Elementary and Secondary Education 



On May 14 and 15, 1970 representatives of the state education agencies, 
various institutions of higher education and local education agencies of 
the six New England States attended an Invitational Conference on Measure- 
r ,.et.t in Education which had as its theme, ,T Thc Use, Misuse, and Abuse of 
Tests", This conference, for which Rhode Island served as Host State, 
represented the first of the annual spring conferences to he convened by 
the New England Association for Measurement and Evaluation in Guidance 
and emphasized practical application of the issues explored. The New 
England Association for Measurement and Evaluation in Guidance is a newly 
organized affiliate of t’ c national Association for Measurement and Eval- 
uation in Guidance which is a division of the American Personnel and 
Guidance Association. Sponsorship was shared oith the Test Department of 
Harcourt, Brace and World, Inc. and the Rhode Island State Agency for Ele- 
mentary and Secondary Education (Titles I, ESEA and V-A, NDEA) . 

The conference was designed to: (1) provide a forum for the examination 

and discussion of some of the most vital issues related to measurement 
3nd evaluation as they effect education today; (2) facilitate communication 
among and bring together fjr more active involvement educators from a variety 
of disciplines and from all levels of education within the New England region 
as a means of "attacking" current identified problems and concerns relating 
to the use of tests ar.d other evaluative devices in the field of education; 
and (3) stimulate the development of a series of position peters stating 
the point of view of the professional members of the New Englend Association 
for Measurement and Evaluation In Guidance as a group, which may serve as 
guidelines for the field <f education. 

The conference program touched upon several "burning" issues in the 
area of measurement and evaluation as evidenced bv discussion of such ques- 
tions as: What effects or results will national assessment have as an inven- 

tory of knowledge, skill, and attitude? What to test? Whom to test? When 
to test? How much to test? Hew to utilize the test information? What are 
the opportunities for testing to improve education? What need is there to 
improve the use of test results? What need exists for devising new means 
of reporting test results? How can the potential and achievement; of disad- 
vantaged youth be best evaluated? Can test results be reported in a better 
way? What are the advantages and disadvantages of various kinds of norms? 

What is the meaning of testing for accountability in education? To whom 
and how should test results be disclosed? 
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Recurring Issues and Themes 



Emerging from Lhe conference activities were several recurring issues 
and themes. The following reflect some of those which may require particular 
consideration and investigation by professional educators: 

1. Such projects as National Assessment which typify renewed 
concern or questions about the effectiveness of our schools 
and their programs in meeting the r eal educational needs of 
all youth. 

2. The type of test content that can be validated in diagnosing 
the educational needs of disadvantaged children. 

3. The increasingly significant role of the compute r in more 
effectively acquiring and using data about pupils, as well 
as in changing instructional processes and personnel. 

4. The better use of test results for evaluative purposes. While 
tests have been used in the past to evaluate students, there 
is evidence of the need for such instruments to be used to 
evaluate teaching practices, curriculum , and organizational 
factors, Thciefore, how test results night be used for such 
evaluative purposes is in need of further definition. 

5. As measurement will always be with us, greater need for edu- 
cation ot the public exists in terms of understanding the real 
meanings of tests instead of catering to common biases. 

6. As accountability in education is at the forefront, the role 
and functions of school boards, as policy makers, take on 
heightened importance, e.g., their strong investigative and 
appraising function. 

7. The eternal question of environment versus heredity perpetuates 
and thus, raises the dual question of what is the nature of 

the child when he comes to us and how can we best work with 
this as a "given". 



Recommendations for Action 



As a result of the fomal presentations and lively small group dis- 
cussions, the conference also produced, in part, the following implications 
for immediate study and action: 



1 



That the New England Association for Measurement and 
Evaluation in Guidance: 



a. Develop and publish a policy statement concerning 
the disclosure and u^e of test results which can 
serve as a position to be adopted by state and 
local education agencies within the New England 
region . 



b. Establish and provide guidelines to aid educational 
personnel within the New England area as to the 
proper use and interpretation of objective data 
in guiding and aiding the educational development of 
each individual pupil. 



That New England professional 
cation level us: test results 
for improvement of curriculum 



personnel at the local edu- 
and other evaluative methods 
and instructional practices. 



3 . 



That pupil personnel specialists 
including curriculum development 



conceptualize 
and revision. 



their 



role as 



In summary, the emphasis in the conference program was on the providing 
of practical information and suggestions from various points of vie\^ and 
levels of authority. Among the program speakers and reactors were included 
nationally recognized test and neasurement experts, college professors and 
researchers in psychology and education, school administrators, and repre- 
sentatives of the Federal educational agency and several State educational 
agencies. The proceedings which appear on the following pages provide sum- 
maries of the keynote and general session addresses as well as of the speeches 
and reports presented at the various small discussion groups of the conference. 
En addition, the reactions, discussions, z nd/or implications tor action that 
these presentations engendered at the conference are mirrored at the end 
of each summary. 



It is the hope of the New England Association for Measurement and 
Evaluation in Guidance that this publication will be of value to >ou in 
your professional work. 



Sincere gratitude is expressed to Dr. Robert W. Read, Publications 
Committee Chairman, for his diligent work that makes the publication of 
these proceedings: possible. 




G 



5 



INNOVATIVE TEST USAGE 
FOR INDIVIDUAL PUPIL GROWTH 



tty DR. PHILIP I CLARK 

Chief Consultant to KJiuation, Programs and Services, 
Test Department, Ilareourt, Brace & World. Ine. 



M What is innovation? M An "innovation" does not have to be new. If educators 
would confront the unequivalence between thtir expectations and student oer- 
formancc, they would become truly innovative. Innovation in test usage re- 
quires a solid working knowledge of testing and evaluation. 

Testing instruments are altered as education changes. Test publishers 
follow changes in instructional materials, curriculum, methods, and phil- 
osophy. While publishers may have ideas for new or altered materials, they 
ordinarily will not be implemented until there is a public to demand them. 

For example, some test authors are interested in eliminating the grade equi- 
valent score but the test users seem to require such a measure. The shift 
in many schools to a nori-graded system is one example of an educational change 
that must affect the use of tests. "If grade is to be diminished in importance 
as a basis for norms within the next decade or eliminated altogether, then 
obviously we must substitute something else as a basis for grouping students.” 

One possibility is the mastery test. Mastery is a method of organizing 
discrete educational objectives which are meaningful to the individual. 

Items in such tests must be quite different from traditional items, for they 
measure stated objectives of instruction, specific for time of a school course 
or lesson. In a mastery test, the score is absolute - a predetermined number 
of correct responses is required to indicate command of the subject matter. 

Each item is more important than the mean score on any particular topic. 

Another crucial question is the measurement of growth. Can we find 
new ways to measure growth? For example, in certain special areas, how do 
we measure growth in a child's self-concept in a Title I program? 

There are two other important questions. How are we going to deal 
with increased pressures fo? teacher accountability? Will computer-assisted 
instructiori change t lie role of the teacher from instructor to social group 
leader and discussion monitor? 

Some current testing trends are! (1) Portland, Oregon has a test 
item bank, allowing for retrieval of items by subject matter and grade 
level; (2) Tiiere is a growing feeling tnat readiness tests are better than 
tests of mental ability at applicable, lower grade levels; (3)There is a 
strong movement away from IQ per se; (4) True item analyses are more in 
demand; (5) Testing in lower and higher grades is becoming more and more 
acceptable; (6) There is a new emphasis on listening in reading; (7) lie 
Instructional Placement Report of the Stanford Diagnostic Reading Test 
gives grouping of children according to similar profiles on subtests; (3) 
Foreign language achievement is being tested at levels rather than grades; 

(9) The Ohio Vocational Interest Survey has been designed to relate results 
of a questionnaire and scores on 2'* interests defined in terms of the world 
of work. 

7 
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Questions from the floor prompted four recommendations: (1) Testing 

children in non-graded situations requires special selection and interpretation 
of tests. (2) Educators must be more concerned with rate of growth than with 
achievement at any given point in time. (3) Test users must become more 
sophisticated in their knowledge and application of materials. (4) Test 
users must begin, as consumers, to demand of the publishers the kinds of 
instruments they need 
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NATIONAL ASSESSMENT 



II V DR- THOMAS R KNAPP 

Associate Professor, College of Education, LTiiverurv of Rochester 



The notion of National Assessment arose because M Ve do l a have product 
measures in education/ 1 the goal of National Assessment i not to compare 
one school to another, or one system to another, but. to measure the use 
and success of the nation's educational resources "in the broadest sense/ 1 
It is similar to a census, but differs in two important ways: (1) every 

exercise has a right answer and (2) a sample of the population is used. 

To assess the country's educational progress, the nation has been 
divided Into four geographical areas (Northeast, South. North Central 
and West) and the population also has been divided into four categories 
(Large Central City, Urban Fringe, Middle-Sized City, and Rural or Small 
City). Two populations (school districts and census tracts) have been 
sampled in order to assess nine, thirteen, and seventeen year olds and 
also young adults (twenty-six to thirty-five). The samples have been 
further stratified by sex, color and soc io - educational status. Out of ten 
subject matter areas, two to four will be samoled each year. These ten 
areas are: Art, Citizenship, Literature, Mathematics, Music, Reading, 

Science, Social Studies, Career and Occunat ional Development and Writing. 

In July of 1970, results will be available for the first assessment. Those 
first results will give a baseline for the assessment of Citizenship, 
Science, and Writing. Areas will be reassessed in a cyclical pattern. 

Some areas (e.g. S« ience and Reading) may require more frequent assessment 
then others. In order to be included, objectives and exercises in each 
area had to be considered important by subject 'latter experts, \;i thin the 
province of the schools, and relevant to the layman. 

Opposition to National Assessment has conn from those fearing that 
it will result in loss of local control of education, but opponents do not 
fully understand its objective: to take a broad look at the educational 

product of the nation and to detemine progress, stability, or regress 
in knowledge, skills and attitudes in ten subject matter areas. 
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Discussi on 



Moderator: Ruth L. Pennell 

State Gu dance Consultant 
Maine State Department of 
Educat ion 

Catherine Corcoran 
Superintendent of Schools 
Southwestern Vermont Union 
School District 



Reactors: Russell A. ^urnham 

Executive Secretary 
Rhode Island Association 
of School Committees 



Harry S. Westcott 
Superintendent of Schools 
Scituate, Rhode Island 

Both Mr, Burnham and Mr, Vestcott agreed that education must become more 
business-like. It must begin to report its progress to the public. National 
Assessment "provides a vehicle for a comprehensive report to the stock holder 
in the next decade. n In order to justify federal, state, and local budgetary 
increments, educators must be able to show that they are doing what they 
mean to do. And, they must be able to define in laymen's terms what it is 
that they mean t'o do. Mr- Burnhan emphasized chat a school boarc, a policy- 
making body, should have a strong investigative function. It must be willing 
to appraise its programs. 



The reactors worried about the possible, and perhaps inevitable, mis- 
interpretation of the results of the National Assessment. As Dr. Knapp 
mentioned, comparison between states is not justified because there are 
no state boundaries in the National Assessment design. Eut the press and 
school systems along with parent groups may be eager to draw such comparisons 
"Cur job is to gather and report raw data," said Dr. Knapp. The results 
will be given in the most general terms, i.e., "Ninety per cent of the 17 
year olds from small rural settings in the Northeast can write a paragraph 
at least as good as .... " 

The readers and the audience were concerned about the "young adult" 
sample. Who is tested? Those at home and perhaps unemployed? What part 
does willingness to participate play in the findings? 

The areas that are evaluated have to be flexible to allow for changes 
in American life. For example, we may have to re-evaluate what mathematics 
skills are necessary in the age of computers. 

Dr. Knapp closed by recommending highly a book written by Frank Vomer, 
Staff Director of the National Assessment Project, and published by the 
National Assessment office in Ann Arbor, Michigan as an excellent description 
of the objectives and design of National Assessment. 
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STATE TESTING PROGRAMS 



By DR PAUL H. CAMPBELL 
Office of Research and Statistics, 

Pennsylvania State Department of Ptiblic Instruction 



The functions of state testing programs are usually a compromise between 
two goals: (1) assessment of institutional effectiveness, and (2) diagnosis, 

assessment, and prediction of individual performance. Standardized tests 
are the nost commonly used tools for both purposes. States may provide a 
scoring service or an advisory service. The "in" idea is a provision for 
a comprehensive assessment program. The institutional type of assessment 
seems to be emerging as the main state concern because individual diagnosis 
and prediction can better be handled at the local level. 



The Pennsylvania Plan for the Assessment of Educational Quality illus- 
trates < re state testing program. The Slate Legislature of Pennsylvania 
passed on- act requiring the development of assessment techniques and allo- 
cated funds for this work. In 1965, a committee developed ten goals of 
quality education: (1) Development of the self-concept; (2) Understanding 

and appreciation of ethnic, religious and racial differences; (3) Mastery 
of use of words and numbers; (4) Good citizenship; (5) Enjoyment of the 
learning process; (6) Good health habits; (7) Opportunity to be creative; 

(8) Vocational development; (9) Appreciation of human achievement in natural 
and social sciences, the arts, and the humanities; (10) Preparation for a 
world of rapid change. 

The purpose of Phase I was to determine the extent to which students 
were fulfil ling these goals. Tour objectives were set: (1) Measurement 

instruments were developed, tested, and refined; (2) Data collection pro- 
cedures for gathering information on school and community conditions were 
developed, tested and refined; (3) Hypotheses concerning the relation of 
community conditions and pupil achievement were tested and analyzed; and 
(4) Computer analytic techniques ueie developed, tried out, and refined. 

The findings of Phase I indicated ’'those factors which pupils bring with 
them - levels of previous learning and educational and occupational levels 
of parents - are most significant in determining how well pupils achieve.” 
More startling is the finding that in many of the goals, less than half 
of the differences in pupil achievement is accounted for by these factors; 
schools can and do make a difference. 

Phase II designed to: (1) Provide patterns of student performance 

on each of the ten goals; (2) Reconfirm the hypotheses; (3) Provide regression 
weights for use in subsequent phases; and (4) Establish adequacy of the 
measuring instruments. 



Under Phase III which begins in the Fall 
will be able to implement the developments of 
will be in terms of student performance, with 
schools, and communities taken into account.” 



of 1970, school personnel 
Phases 1 and II. "Assessment 
differences among individuals, 
Four analyses and reporting 
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procedures will characterize Phase III: (1) Prediction of Expected School 

Means; (2) Comparison of Expected and Actual Means; (3) Comparison of Ex- 
pected Student Distributions with Actual Student Distributions; and (4) 
Evaluation of Student Responses to Key Items. Where, serious discrepancies 
between expected and actual performance exist, school personnel will be 
able to modify programs. Where predicted and actual achievement agree, 
parents and teachers may wish to move out of their expected output category. 
Where discrepancies are positive, local and state personnel will ascertain 
the contributing factors so that other schools may benefit. 



Discussion 



Moderator : 


Dr. Grace M. Glynn 
Associate Director 
Rhode Island State Agency 
for Elementary and Sec- 
ondary Education 






Reactors : 


Paul E. Campbell 


Dr. 


Donald R. Randall 




Consultant, Testing 
Se rvices 


Dire 


ictor of Research and 
Tec ting 




Rhode Island State Agency 
for Elementary and Sec- 
ondary Education 


New 


Hampshire State Depart 
ment of Education 



In the discussion it was brought out that State testing programs were en- 
couraged by the availability of data banks, computers able to handle eighteen 
or nineteen variables simultaneously, legislative pressure, and the employ- 
ment of research and development people by the State Departments and/or 
Agencies of Education. In New Hampshire , data are being accumulated on In- 
dependent Variables (socio-economic status, school budgets, school staffs, etc.) 
and Dependent Variables (student performance). The most influential of the 
Independent Variables are in the realm of what school committees have 
the power to change. 



Reactors were interested in discovering how legisla 
lightened enough to pass such laws! It seems clear that 
the funding now is federal, states will have to begin to 
grams . 

Problems of administration were raised. The rencto 
expressed concern regarding teacher misadminist ra t ion of 
test results, and the general hostility to state testing 
training of testers on the local level and personal cont 
coordinator (appointment by the superintendent) , the sta 
sentative, and the school personnel contributed to the s 
vania Plan. The Pennsylvania Plan did not result In the 



tures become ei<- 
although most of 
support such pro- 



rs and audience m 
tests, slow retij] 
programs. In-t.erv.tr 
act between tht 1c 
te department repre 
uceess of the Pennsvl 
ranking of schools. 
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TESTING THE DISADVANTAGED 



By DR. LEN'ORE A. DE LUCIA 

Professor of Psychology, Rhode Island College 



The goal of an evaluation is to determine if a particular educational program 
is successful. But how do we define success? Formerly, evaluation of pro- 
grams was voluntary; with the advent of federal legislation designed to aid 
the disadvantaged, evaluation was mandated. Evaluation has, for the most 
part, been program-oriented. Has the reading level of a group been raised 
by participation in a certain program? In Rhode Island, the State Agency 
has moved from a program-or ientatic n to a child-orientation in its evaluative 
procedures. “Compensatory programs are only successful if the children in 
them are successful . n The State Agency worked to help those closest to the 
child, the teachers, to focus their attention on the individual child. 

Unfortunately, the evaluative needs of the federal and state governments 
are not often congruent with the needs of local school systems, the class- 
rooms , and individual children. Traditional achievement tests were admin- 
istered for evaluating success in certain objectives of the compensatory 
programs, 1. e. reading. But n We know there are other ways to measure be- 
havior and other behaviors to measure.* 1 

To measure the successful achievement of other objectives, the unobtru- 
sive instruments must be developed at the local level. Only the local per- 
sonnel are able to determine success criteria for their particular children, 
but “There seems to be a feeling of incompetence among teachers to develop 
locally made evaluation techniques. The farther the origin of the evaluation 
instrument from the local level, the more validity ic is granted. Nothing 
could be farther from the truth.” A teacher is limited in designing unob- 
trusive instruments to measure success only by the limits of his or her imagin- 
ation. Does the child take out more books from the library? Is he tardy 
less often? Absent less often? 

Local evaluatic* must* serve a feedback function. Information must go 
back to program administrators and designers. “The only justification for 
evaluation programs is to improve them. 11 Therefore, Dr, be Lucia, uf ; ng Bloom's 
terms, supports “formative 1 ', rather than “.»ummat ive" , evaluation. 1 ihe use 
of formative evaluations after each separable unit or task in the learning 
process can do much to motivate the student to the necessarv effort at the 
appropriate time. 11 

Rosenthal and his associates st ed the relation of teacher expectation 
to student per forr, iance. . Dr. DeLucia wonders if the self-fulfilling prophecy, 
supported by their findings, might be arrested by witholding student records 
from teachers. Should we burden the teacher with the knowledge that a cer- 
tain child has a history of failure? Shovjld we burner, the child with such 
a label? 
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Dis cuss ion 



Moderator: Quentin D. Sprague 

Director of Guidance 
Cape Elizabeth! (Maine) 

High School 

Vincent J. Worden 
Assistant Professor, State 
College at Bridgewater, 
Massachuset t s 



Reactors: Dr. Janice Cc. T sill, R.S.M. 

Reading Consul tant /Diagnos- 
tic ran 

Title I ESEA - Newport, 
Rhode Island 



’'Doctors have 
better; their 



it good; 
mistakes 



they bury their mistakes. Teachers have it 
bury themselves. 1 ' (Dr. Vincent J. Wordenl 



even 



There was basic agreement with Dr. DeLucia's presentation, 
felt that local evaluation is essential, considering the variet 
munity variables (language, home , etc.) She wondered if the st 
and/or agencies might offer their expertise in the development 
uative instruments and good research design. She cautioned the 
the assumpton of validity given to an "objective 11 test, the ass 
holds "if it’s objective, it must be right." 



Sister Cov r sill 
ies of com- 
ate departments 
of local eval- 
public about 
umption that 



The Sister and Dr. DeLucia discussed 
Covsill felt that if they are valid (and s 
we should educate teachers to be more prof 
eating their biases, rather than throw out 
measurement field. 



the Rosenthal findings. Sister 
he does not yet grant their validity), 
essional, show them research indi- 
twenty years of development in the 



Dr. Worden was concerned with the prac t ical ■ problems of compensatory 
programs. Where do we find minority group personnel to staff the programs? 
Anne Anastasi (in an article published in 1953) indicated that children per- 
form better on tests if they are administered by members of their own race. 
What are the implications ot that for evaluative testing and for teaching? 

How can we adjust to the knowledge that the disadvantaged have little achieve- 
ment motivation? Dr. Worden made a plea for early intervention. Present test 
content appropriateness for diagnosis is an issue that needs attention. He 
argued that providing for early intervention is more important than testing. 



Must tests be administered exa c tly according 
An audience member felt that the relaxed interact 
child was severed by the requirements of publishe 
instruction-giving process seems inappropriac ‘ ;o 



to the Manual’s directions? 
ion between the teacher and 
rs. The stilted, rigid 
serving the disadvantaged. 



Finally, all acknowledged the need for pure 
programs. Such research would require a control 
to deny the benefits of compensatory practices to 
the needs of research. Therefore, basic research 
by Title I . 



research on compensatory 
group, and few jre willing 
needy children to satisfy 
probably will not be funded 
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COMPUTERIZATION IN RELATION TO 
TESTING AND EVALUATION 



By DR. JAMES R. BAKER 

Director et tue Research and Development Center 
Massachusetts State Department of Education 



The three major functions or applications of computer technology in relation 
to testing and evaluation are: (1) administrative; (2) training and; (3) 

instructional. Computers can supply accurate analysis of student data and 
provide information for assistant superintendents and teachers, facilitating 
their efforts in the decision making process- The two primary types of data 
which could be derived are: (1) descriptive, e.g., pupil environment, nature 

of behavior, processes and; (2) data regarding the field of measurement, achieve- 
ment and ability testing. 

Valuable judgements cannot be made about a student unless a reasonably 
objective observation ensues from measurement information. Education has not 
arrived at a particularly sophisticated level of operation. Specifically, 
limited data are transmitted from teacher to teacher, school to school, school 
to college. Merely looking at a students cumulative record shows a teacher 
very little about the student and his abilities. A listing of A’s, B’s, and 
F's is simply confusing. 

In addition- to giving evidence about a student's performance in a mean- 
ingful form, methods must be developed to provide vial te avenues of interpre- 
tation of the effectiveness of teaching methodologies. The Federal Government 
is making great demands of Title I programs now and the present accumulated 
data base is inadequate to meet these demands. Computer technology could pro- 
vide the required storage of descriptive materials and provide the inf orma t ion 
for effective analysis of a given methodology. 

Computer applications operate at two levels. The first, assuming that 
there won't be any extensive trend toward computer assisted instruction, is 
concerned with the analysis of descriptive data about a student, recording 
measureable, transmit table data, detailing his educational progress. Further, 
such applications would provide an analysis of educational quality? a com- 
munity's needs and advantages and the reasons for the expenditure for each 
student as compared with other school systems. A computer system would give 
a reliable inter-community cost comparison, e.g., average cost of test books, 
expenditure per pupil for guidance facilities, etc. 

The second level is that of instruction. An example of the instructional 
component would be the C.A.M. Project (Comprehensive Achievement Monitering). 

In this program, students follow a curriculum set a; d have periodic examinations 
whi are graded by computers, giving them a complete diagnostic report. The 
report includes comments about their strengths and weaknesses as well as 
suggestions for further studying or review. The C.A.M. Project, however, is 
only a minimal application of computer technology. With the appropriate 
staff, linguistic and instructional experts and computer programmer s , pro- 
grams for learning in accordance with each student's individual needs could 
be developed. With a combination of teacher and computer, the student could 
learn more effectively and more accurate, transferable assessments of a stu- 
dent, his abilities and weaknesses, could then be made. 
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Discussion 



Moderator: Louis Gelsomino 

Coordinator, Personnel and 
Pupil Services 
Portsmouth (R.I.) School 
Department 



Reactors: Dr. Robert D. Cloward 

Professor of Psychology 
Rhode Island College 



Dr. John F. Espey 
Editorial Liaison Officer 
Test Department 
Harcourt, Brace & World, Inc. 



One of the primary concerns facing educational administrators is the per 
pupil cost of education. For school systems to initiate a greater use of 
computers, three primary problems mist be dealt with. The Public must be 
convinced that the investment is legitimate, that it will not only facilitate 
but enhance the learning process. Each year, as it is now, superintendents 
have difficulty with budget approval. If the public can be convincea that 
computers have educational merit, acceptance will probably ensue. Closely 
related tc this problem is a second consideration, suspicion and fear. 

Neither the role of the computer nor the role of tiie teacher, nor their 
relationship has been clearly defined. Does computerized education mean 
the replacement of the classroom teacher or will the computer function more 
as a resource agent to the teacher? The third problem is that hardware 
tie-ii.s and computers themselves, are not yet ready to be used on a large 
scale educationally, at least on an instructional level. There is no way 
at present to tie in Honeywell Computers with those made by IBM. For the 
most effective data bank, this must be accomplished. 

The computer has been characterized as a very fast idiot. One must 
know how to use it because it only does what it is told to do. School 
systems which now have computers often don't use them to their full capacity, 
primarily because they do not knew how to use them most effectively; they 
don't have the appropriate personnel. Because of this consideration and an 
examination of a computer's full potential, perhaps the role of "teacher" 
as it is presently conceived and the composition of a school's faculty will 
change. The programmer would become extremely important. However, he 
would not be effective alone. He would have to work close y with instructional 
and linguistic experts. The programs' primary purpose, naturally, will be 
to initiate, facilitate and continue the learning process. To do so, the 
language used must communicate the intent, goal, and purpose the instructors 
had in mind. Therefore, there will have to be extensive coordination in pro- 
gram development. 

It has been suggested that with the advancement of computer technology 
in education, three catagories of teachers will evolve: pupil managers, 

subject experts and learning diagnostic iars . The pupil managers would 
function in a supervisory capacity, instructing the students in the use of 
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the computers and assisting the children in whatever way necessary. The 
subject expert teacher would be one who enjoys leaning. He would be re- 
sponsible tor task analysis and would work in conjunction with others in 
the development of programs. The learning diagnostician would function 
much an a guidance counselor. When a child demonstrates learning diffi- 
culties, he would deal directly with the student to determine whether or 
not the program meeLs the child r s specific needs or if other intervening 
variables are interfering with the learning process. 

The ccmputer can give a more complete diagnostic report of a stu- 
dent's abilities and weaknesses. It can give a thorough diagnostic print 
out which would be interpreted by the student and teacher showing what 
needs to be learned and what was learned well. If information is to be 
transmitted from school to school, school to college, the computer 
provides the most efficient, comprehensive vehicle for this task. 

Further, as an instructional medium, its potential is just beginning 
to be considered. 
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TESTING AND ITS RELEVANCY TO THE SEVENTIES 



By THOMAS BURNS 

Acting Associate Commissioner of Education 
United States Office of Education 



There are many prophets of educational doom in the United States and 
much cf their pessimism is warranted. However, thev are quick co overlook 
what education has done well and seem to ignore the strong directionality 
that education is assuming toward more relevant programs and methods of 
learning. They also seem unaware at times of the large number of capalle, 
creative teachers and administrators v;ho are beginning to improve the edu- 
cational process dramatically. 

Fart of the explanation of vhv education is not as valid or relevant 
as it should br is to be found in testing. Ve nave misused tests and dir- 
ected them to the wrong object: the student. If educational accountability 

has any meaning it is that the professional must be responsible for the 
products of his actions. Hence, the student isn't the failure, it is the 
school. As it is seen now, however, no teacher, administrator or counselor 
is responsible if a child fails. This is ludicrous and must end. 

The growth of testing, evaluation and counseling during the past fifteen 
years has been phenomenal. Testing has increased at a rate greater t^an the 
school population. A stuient during twelve years will typicallv take five 
standardized achievement test series in three to nine subject areas. In 
1954-55, 169,598 candidates took the College Entrance Board Examination. 

In 1968-69, 1,956,422 candidates took it. 

The counseling profession has also experienced a similar rapid growth. 

In 1962-63, the secondary counselor ratio was 1:530. In 1967-68 it was 
1:420, a grox^th of 26.4??. Government spending for counseling has also in- 
creased as a result of a national concern over the public schools. It had 
its origins in the late 50 f s: the cold war, the stalemate in Korea, and 

the orbiting of Sputnik. Suddenly the Russians x%*ere ahead in our race for 
survival. Our economic superiority had vanished and nov T our technological 
genius was in question. The intervention of the Federal Government into 
education had one single purpose: to identify, cultivate and nromote tal- 

ented students who could contribute to the growth of the United States. 
Testing seemed to be the best vehicle to meet this end. 

The testing boom was assisted by the growing confidence in the social 
sciences and the alleged benefits that would come from the application of 
a scientific method to sociological problems. As the Government increased 
its demand for product assessment, educators increased their use of testing. 
Schools became extremelv efficient at deciding \v T hich student was bright and 
worthy of college and which was not. Thev became channeling, sorting and 
certifying institutions, every bit as powerful as the draft itself. The 
past decade xtas an era xthich indicated that we must not penalize the bright 
student by putting him into a class of dullards. (Besides, the dullards 
would rather learn xMth each other, wouldn't they?) During these years of 



the quantitative and qualitative change, we never once asked which school, 
which superintendent., which teacher, or counselor was the worst. Not once 
did we ask what kinds of teaching methods were the best. 

We directed our questions about students to tests that couldn T t provide 
the answers. We expected group tests that were unreliable with questionable 
validity to give us answers about specific individuals. The counseling 
profession has rigidified and strengthened this situation, rather than 
attacking its injustices. The remedy for this system is the application 
of the principle of accountability of the profession in the following wavs. 
Counselors should thoroughly review and critique the tests being used in 
their systems by raising such questions as: do the tests have content val- 

idity? From what sources do they derive their concurrent v.’liditv? How 
reliable are they? Tracking should also be reviewed and critiqued, with 
a specific look at the consequences of tracking. The school system 7 s voca- 
tional program should be studied to be certain that it is a real program, 
not just a dumping ground for those who are not going on to college. The 
opportunity for a student to move up in a tracking situation should be 
analyzed . 

These are statements that are currently being considered in the Fed- 
eral Office of Education. P erhaps these questions assign blame incorrectlv, 
but the fact is that these are the kindest comments being made in Washington 
today. Already many have given up hone. For those who have not, this is 
the eleventh hour for education nnd education must stand un and be accountabl 
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FEDERALLY FUNDED PROGRAMS 



By THOMAS BURNS 

Acting Associate Commissioner of Education 
United States Office of Education 




Mr. Burns made his presentation very informally, 
c.ussion and interaction. 



preferring more 



group di;;-* 



He presented a summary 
with respect to the Element 
27 federal programs at a co 
in the United States Office 
the federal level amount to 
50% control by the Office o 



of the legislation for the 1970 Appropriations 
ary and Secondary Education of 1965. There are 
st of $2 billion, which is 50% of the allocation 
of Education. The funds going to education on 
$10 billion, so in actuality, there is less than 
f Education. 



The following is a summary of appropriations presented bv Mr. Burns: 



Title 


I 


1970 




1971 




Title 


TI. . 


1970 




1971 




Title 


III. ■ 


1970 




1971 




Title 


V 


1970 




1971 




Title 


y 1 . . . 


Title 


vn, . . 


1970 




Title 


vin, 



Program for Disadvantaged-Elementary and Seco darv 
$1,339 billion 

House Recommendation - $1.5 billion 

Librarv Resources 
$42 . 5 million 

House recommendation - $80 million, with a strong emphasis 
on the right to read - every youngster will read before 
he leaves school. 

Innovative Programs 
$116,339,000 

$137,339,000 ($21 million additional) 

$4 million - right to read 

$17million - guidance, counseling, testing 

Strengthening State Departments and/or Agencies of Education 

$29,750,000 

remains same 

Education for the Handicapped from $84 million to 
$105 million. 

Non -English Speaking Education Program 

$21,500,000, a narked increase from $7.5 million in 1969. 
Drop-out Prevention Program from $5 million to $8 million. 
Appeal to Congress to increase to $15 million. 



In addition: 



Recommendations that the Pinpoint Disaster Program not be funled 
federally. The Commissioner lias approved this recommendation. 
Cuban Refugees Fund - If anv state has a 20% increase of Cuban 
refugees within three years, that state would be entitled to 
federal funds. Tidings Amendment - allows the carrying over ')f 
funds from one year to another. 
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Following this summary, Mr. Burns spoke of the delay in the 1970 approp- 
riations. This delav which produced a tight time squeeze caused many problems 
associated with late funding, magnified also by unavoidable State Department 
and/or Agencies delays. Mr, Burns commented that due to the results of delays 
in fiscal year 1970, we have noticed a definite change. He thus concluded 
that 1971 allocations would be known prior to the start of the 1970-1971 
academic year. 



Discussion 



Moderator: Richard P. Tardy 

Director of Elementary 
School Guidance 
Concord, New Hampshire 



Reactors: Dr. Catherine M. Casaerlv 

Assistant Superintendent 
Providence (R.I.J School 
Department 



Dr. Wallace Rob * 

Consultant , Compensatory 
Educational Program 
Connecticut State Department 
of Education 



In reacting Mr. Burns 1 presentation, Dr. Roby commented that once equipment 
has been purchased, he sees no real effort to provide "data base. ’ Mr. Burns 
agreed that the secondary and elementary levels have not vet learnea to get 
greater milage from the computer. They only seem to use it for scheduling 
to date . 



Dr. Roby then raised the question regarding the hidings Amendment, "If 
funds can be carried over another year, will there be a cut in the following 
years' allocation?" Mr. Burns thereupon stated, "There is no cut in funds. 

The funds would be at least as much as the previous vears 1 funds, or perhaps 
more. The idea is to completely spend the entire years' funds first, before 
touching the following year's funds.” 

Dr. Catherine Casserly recommended more funds for increasing school per- 
sonnel. The major reason of failure, she believes, is that students have 
not been taught. They have merely been exposed to ideas, but not to teachine. 
In discussing accountab i 1 i tv (i.e, doing what vou said you would dc relative 
to defining and carrying out objectives), Dr, Casserlv pointed out that 
accountability goes back to behavioral objectives; i.e. "do your thing" 
that will really teach children. There is a great shortage of evaluation 
personnel, and she sees the need for evaluation in education by means of 
fcllow-up and follow-through. 

In response to the ciuestion as to whether there is am f possibility for 
adu 1 t education beyond the eighth grade receiving federal funding, Dr. Casserlv 
replied that vou cannot use Federal monies for adult high school diplomas. 
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Presently, the Office for Economic Opportunity pays for high school equiva- 
lency. Hr. Burns pointed out that such a possibility might take a new piece 
of legislation. Should adult education beyond eighth grade be a federal 
funded responsibility? Or should not this be considered a good cause for 
local tax payers? 

Mr. Burns concluded the discussion by offering the following three 
points : 

1. The need to concentrate on good planning rather than working 
within the budget. (He believes in the systematic apProach-bui iding 
for the sake of good planning, rather than getting locked into a 
budget . ) 

2. The right of every youngster to obtain the education he wants 
and needs, be it vocational or academic - e.g., at age 16, a 
boy should be able to go out and run his own gas station, if 
this is his wish, 

3. The necessity for the extension of the domain of PuDil Personnel 
Services to include guidance and counseling relating to helping 
youngsters while at the sama time providing a service for them. 
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DISCLOSURE OF TEST RESULTS 



Bv THOMAS P. NAT.LV 

Professor of lYnK.it ion. University of Rhode Island 



Testing is at best a complex business fraught with dangers of misconceptions, 
misinterpretations and misuses. The goals are noble, the means still open to 
many questions of a psychological, sociological, and technological nature. 

With this in mind, any consideration of the disclosure of test results must 
consider at least four areas: (1) the invasion of the individual's nrivac t ; 

(2) the protection of school personnel from possible legal action; (3) the 
parent's right to information contained in pupil records and (4) the public's 
right to know on standardized measures the results of the performance in 
the schools it supports. 

The debate over privacy seems to center around two issues, the consent 
of the student and the confidentiality of the information. Test cases have 
not as yet reached the courts although the Association of the National Council 
on Measurement in Education is attempting to get a half dozen subpoena-of -data 
cases on the docket. The American Civil Liberties Union supports a noiicv 
which is designed to protect the privacy of students with regard to pijspective 
employers. They state that the school personnel mav assess the student's 
ability to perform but not questions of loyaltv, patriotism or morals. The 
American Psychological Association in its statement on psychological assess- 
ment and public poliev states emphatically that "an individual should be 
protected against unwarranted inferences bv persons not equipped with the 
requisite background of knowledge." 

The second issue, that of protection of school personnel from legal 
action, is quite clear so long as such personnel do not maliciously slc-rder 
the pupil. Truth is the best defense for defamation and there, is furtb: r 
legal protection under the concept of privileged information. Indiana actually 
has a statute protecting school personnel. 

The third issue, parents rignt to know, is also quite clear-cut legally, 
even though the argument over disclosure continues. It is contended tuat 
parents can set enlightened goals for thei children if they have the 
appropriate information. In contrast, school personnel, opposing the nraoti cA 
of telling parents each child's test scores have claimed that nanv parents 
do not understand how to interpret tesc result!, wisely and freque tly distort 
tha meaning of scores. 

The fourth area of discussion is bv far the. most controversial. The 
issue of disclosure of test results on a system, state, reeion, or nation-wide 
basis has generated far more heat than light. The earlv attitudes of school 
administrators are revealed in the American Association of School Administrators 
position of opposition on National Assessment. True concerns certainlv can 
be generated for the problems which well night arise from the nisinternretat ions , 
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misconceptions and misuses made of the results of testing programs by those 
who are partiallv uninformed or misinformed as well as those with ulterior 
motives. The arguments for releasing test results are: (1) to increase the 

accountability of the public schools; (2) to identifv inadequate performance 
attributable to inadequate programs, etc.; (3) administrative leadership 
might be created as educational leaders seek to educate the public regarding 
pioper interpretations of a system's scores; (4) rapidity of change might 
well be encouraged; (5) characteristics of various populations might veil 
Le highlighted. 

The arguments against disclosure are: (! ) the disclosure of test results 

could lead to a dictation of curriculum bv test makers; (2) in manv instances, 
the tests do not take into account the localized character of educational 
programs; (3) disclosure will create excessive pressure on puoils , teachers 
and administrators to achieve as measured bv tests; (4) disclosure may lead 
to unvarrented and unrealistic comparisons of schools and/or school systems; 

(5) the limitations of tests and testing programs are well known tc professionals 
in the field of measurement. Interpretations are complex. Disclosure must 
be accompanied by an extensive educational campaign if misconceptions * misin- 
terpretations and misuses are to be avoided. 



Discussion 



Moderator: Shirley M. Reid 

Counselor , 

Rutland (Vermont) 
Senior High School 



Reactors: Mrs, Ann Hill 

Director of John Hope 
Settlement House 

r n pj. - j- 



Dr. Ellis D. Tooker 
Superintendent 
Hartford (Connecticut) 
i/Uciiu oi education 



Learning is colored bv emotions on the part of the student and the teacher. 
Children aren't usually judged accurately by tests and teachers are often psycho- 
logically tricked into certain methods of teaching. If a teacher has been 
told that a child has tested low, lie will teach with little expectation. This 
is unfair to the student. Testing, as it is presently conceived, is geared 
to the middle class student and has a definite tendency to freeze individuals 
into specific achievement levels. The disadvantaged student suffers the most 
from the instant, seemingly immutable categorization. Since he does not perform 
well on tests couched in middle class terms, lie is labeled as dull, unable and 
inferior. In many instances, when test scores are ignored, such a student 
can begin to excel and develop intellectually since he is not constantly re- 
minded by another achievement test score that he simply does not have the 
abilities to perform veil. 
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Tests have serious limitations which should be examined closely. Test 
scores are generally viewed by the public and by many teachers as final, de- 
finite, discrete and unchangeable. It is not the test maker who has made 

this assumption. It is the individual who works from little real knowledge 

of tests who generates the misuse of tests and causes score disclosure to 
be a risky venture. 

Private industry as well as the general Public has come to believe 
that there is something mc.gic about testing. Industry sees it as a possible 
answer to all of their "employment ills," However, standardized tests were 
rover intended to answer all questions about an individual. Global intelligence 
cannot be measured. As testing is now constructed certain kinds of abilities 

can be examined that are necessary for particular aspects of education and 

success. Creativity, some attitudes, physical abilities, motivation, talents 
in art and music, however, pose a problem for the tester since it is extremely 
difficult to measure such aspects accurately. 

A problem associated with the disclosure of test results is the lack of 
interpre tational abilities by the teacher and the partnt. If a teacher assumes 
that a test score is 100% accurate and teaches in accordance with the score, 
le is making a mistake. If test results are to be disclosed, the scores must 
be given out with an accurate interpretation of their meaning. Not all 
teachers have the necessary knowledge to understand a score on a standardized 
test and it is unlikely that most parents do. Tests as presently constructed, 
fail to assess the child as a whole; his mind, his body, his emotions and 
those factors which play upon him. 
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NORMS: FACT OR FANCY 



By DR. WALTER N. DUROSF 

Educational Consultant, l est Scr.ice and 

Adv isement Center, Universitv of New Hampshire 



Standardized tests, in the modern 
The procedure of obtaining norms 
formal, unscientific approach to 
doiu sampling of large number 3 of 



sense of the word, are re 
has developed enormously 
a highly complex process 
pupils , 



latively young, 
from a rather in- 
of stratified ran- 



The use of mental ability measure along 
vides assurance that the norm samples tested 
population on measured mental ability. 



with the achievement test 
are representative of the 



pro- 

national 



New uypes of norms have been developed which are in many ways more ser- 
viceable than those previously available* especially stanines. Great encourage- 
ment. also has been given to the practice of establishing local norms using 
s t a nines , 



Grade equivalents, widely 
the professionals in Measuremen 
averages, not pupil scores. Th 
in the 9 or 10 month school yea 
covered by a given battery, the 
and test to test, all argue aga 
with peer groups are much super 



used by popular demand, are largely d 
t. Their main value is in the i.nterp 
e assumption that a 12-month gain rea 
r, the unwarranted ext r apolation to 1 
lack of equality of units from level 
inst its use. Norms making pc- sible 
ior . 



iscredited by 
retation of 
l!y occurs 
evels not 
co level 
comparisons 



Criterion reference testing (or test interpretation) is being talked about 
as if it were new. The adage, "Anything worth doing, is worth doing well' 1 
(perfectly?) defines the philosophy of its proponents. When an hierarchy 
can be shown, mastery of a skill prerequisite to success at a higher level 
makes sense; 100% mastery of much of the trivia in the curriculum does not. 



The advent of optical scanners and computers has made the processing of 
tests a thousand times more rapid but the logistical problems of transporting 
the materials to a given testing center and of distributing the results still 
cause troubie. 



A renewed emphasis on item analysis in the achievement test area where 
it is relevant has thiovn the teacher’s attention back to the item as the 
essential building stone of ~ny test. 



Testing and related methods cf objective evaluation have more relevance 
than ever in the area of the individualized curriculum. The emphasis of the 
day is on a ccou ntability and the need Is for more precise and accurate ways 
of evaluating educational outcomes in order that the methods of teaching, the 
content of instruction, and the organization of the schools may become more 
effective . 
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Discussion 



Moderator: Clarence H. Steinberger 



State Guidance Consultant 
Connecticut State, Depart- 



ment of Education 



Reactors: Dr. John A. Finger, Jr. 



Dr. Joseph A. Whelan 
Curriculum Director 



Director, Educational 



Services Center 
Rhode Island College 



North Providence (R.I.) 



School DeDartment 



In the discussion it was pointed out that teachers need to get involved in 
the testing situation and not put test results aside. Tesc results are 
extremely important at the time they are received, not days, months, or 
years later. 

Programmed Instruction has not proved '.:o be differentiated to the class. 

The process of education is verv complicated. We need to use everv means 
available to inform us of what we are or are not accomplishing. Testing can 
give us a great deal of objective data, but in the fin; j l analysis, the child 
must satisfy his instructors and the school that he has learned. It is the 
instructor’s responsibility to communicate with the children so effectively 
that thev will learn those things on which are placed the most value. 

Dr. Durost believes the "normal curve" will never be repealed. Accounta- 
bility has to be directed to teachers and curriculum makers, as well as to 
children. We must present the child with a relevant curriculum. There must 
be continuing instruction in basics, as a child has to know how to read and 
work with numbers to cope with todiv's world. 
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TESTS: WHO OR WHAT IS BEiNG EVALUATED 



By DR. C THOMAS SKAGGS 
Assistant Professor, College uf Lducjtion, 
University of Maine 



The processes of measurement and evaluation are a foundation on which 
stand the functioning of man and his society. The processes have been 
in use since the earliest introduction of man onto this planet. The 
basic principles of measurement and evaluation, although not formally 
organized into a science or a studiable field of knowledge, were 
employed by even the earliest civilizations. As individuals and 
their society became more complex there were increasing demands placed 
on their "measurement technioues . " 

When we are confronted with any decision, we apply seme type of 
"measuring instrument" to the situation aid obtain an estimate or 
impression of the status of the circumstance. On the basis of our 
past experience and our assessment of the situation, we evaluate the 
total happening and reach a decision. Some thought on the part of 
each of us will produce many examples of our routine use of measure- 
ment and evaluation in the dec ision-making processes we employ in our 
own behavior. This is an informal, non-sc ient i f ic , often unconscious 
application of measurement and evaluation techniques. We test the 
circumstance and make an evaluation of the test results in order to 
aid us in determining a course of action. 

A second phase of the measurement and evaluation scene is our 
use of the techniques in an organized or structured manner; the de- 
velopment and synthesizing of our int ui t iveness into a defined 
science — the science of psychometrics. As defined by Lee J. Cronbach, 
this term refers tc t*"e obtaining of a numerical estimate of some 
aspect of performance at a given time. A most familiar application 
of this science is by those of us who share responsibility for the 
American educational system. 

In general, the most common application, which is achievement 
testing, has two branches: (1) teacher-made classroom tests and, 

(2) prof essionally developed standardized tests. While both types 
of tests are designed to assess basically the sane variable, 
achievement, the two are not interchangeable in a school testing 
program. Each has its own use and misuse. It is generally agreed 
upon that the primary purpose of testing and obtainin', : 2st results 
is to aid in the improvement of the teaching-learning access. In- 
formed use of test results in this manner is certainly a worthy ex- 
penditure of effort and a worthwhile goal, Unf ortunate ly , however, 
test results are often misused. In order to look good, teachers 
sometimes desert the approved course of study and teach for the test. 
Administrators use test results to evaluate teachers and teacher 
effectiveness. Tests tend to freeze the curriculum in the patterns 
approved of by the test makers. The results of national and state 
programs are unfairly used to compare school systems. Testing programs 
promote undesirable competition among schools. 



Students express the following points of ^iew in relation to 
testing. Tests are not used properly in the cLassroom, nor do they 
directly help the student. The instructor does not use the test 
results to improve his course. Most tests are very poor. They 
don r t measure anything beyond verbal level of learning. Finally, 
teachers feel that they must give tests to help them in assigning 
course marks rather than using more appropriate criteria., 

In conclusion, when asked M Tests--Who or What is Being Evaluated? 1 ', 
iti the broadest and most responsible sense of the rcord, the implica- 
tions of the science of measurement and evaluation are. so far 
reaching that nearly every phase of our total being is under 
evaluation. The practices of testing in today's society is an aspect 
which we all must responsibly evaluate and be certain of where it is 
leading us i\ our very competitive American culture. 

Discussion 



Moderator: Sister Mary Edward, R.S.M. 

Assistant Superintendent 
Diocesan Schools, Rhode 
Is land 



Dr. Dorothy D. Moore 
Instructor in Education 
University of Maine 



Dr. Robert W. Read 
Associate Professor of 
Counselor Education 
Northeastern University 



General audience discussion centered around teacher abuses of tests. 

Very often, tfichers who have never taken a test and measurement course 
in college try to measure the achievement of their students. They are 
the most guilty of misusing tests. Parents in conversation with 
teachers, frequently request information about their child's test scores 
so that they can use them merely as status symbols thrown out casually 
in conversation at cocktail parties. Even though no test Measurement 
is absolute, scores are usually treated that way. 

Teachers are, on occasion, guilty of teaching the test but it is 
their fault only indirectly. Parents and school administrators apply 
much pressure to have their children excel on standardized tests in 
relation to national norms. If the teacher does not teach the test 
and the children do not do well, the implications for the teacher 
are clear. In response to this, Dr. Moore agreed that tests aren't 
usually used to help the student. More should be done vitl the tests 
than scoring and filing them. They can and should be used as 
diagnostic tools which w T ould indicate to both the teacher and the 
student a study directionality. Diagnostic test results point up 
areas of strengths and weaknesses and indicate clearly what needs 
to be done or redone and w T hat was done adequately. 
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The aujience and panelists concurred that curriculum does often 
and up being directed by standardized tests. Such a dictation creates 
a middle class bias in curricula since most standardized tests are 
geared for the middle class student. In turn, v?hen a child from a 
lower socio-economic level is given a standardized test, he invariably 
comes out a: the bottom since the test is not appropriate for him. 
However, such achievement tests present fewer problems for students 
than teacher-made tests. Teachers aren’t adequately prepared to 
develop anc interpret the scores. Further, the self-made tests are 
plagued with low reliability and validity coefficients. 

There is no point, as Dr. Read emphasized, in testing unless it 
has implications for the future, unless the teacher does something 
with the information to help the student. Tests will always have 
limited value, however, since their predictive powers are generally 
low. Tests are used to evaluate teaching, the individual school and 
the school system. A low score on a test might indicate that the 
student has failed in his task, but it rrr'ghu also be an indication 
that teacher, or perhaps the curriculum, are at fault, not the 
s tudent . 
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THE JENSEN REPORT 



By DR. PAUL H. CAMPBELL 
Office of Research and Statistics, 

IYnn\\ lea nia State Department of Public Instruction 



It is quite common for an individual to hear what he want s to hear and 
disregard everything else. This is the fault with the majority of 
people who concern themselves with Jensen* s findings* They take 
excerpts out of context, and take word-of-mouth versions, or make-over 
generalizations, which are not helpful to the solution of the problems 
of providing ample opportunity for self-fulfillment to all mankind. 

Is there su:b a thing as individual difference in ability? If 
so, can it be utilized? Should it be changed? Are there ways of 
educating which really take into account existing differences? 

The investigation of the above questions has challenged the 
beliefs and hopes of many; however, because of this challenge, there 
is no reason to cease the investigation, or to personally attack 
Mr. Jensen, but rather the investigation must continue to bring about 
more hypotheses and further examinations. 

Exactly what does Jensen say? 

First, he says that compensatory education has been tried and has 
failed; and to provide evidence in support of the above statement, 
lie cites the Civil Rights programs saying that none appear to have 
raised significantly the achievement of d i sad van t aged students as a 
group. Jensen's purpose in bringing up this matter of compensatory 
education was to provide evidence to show that heritroilitv accounts 
for from 707 to 907 , of the variance of the obtained scores in spec •“ fie 
populat ions . 

The critics, in general, agree that there is hi eh likelihood Lor 
a genetic base for intelligence. The differences appear to focus around 
the quant i f iab i 1 i ty of the relationship, the possibilities of modifica- 
tion by environmental manipulation, and the role of genetic factors in 
explaining the differences in achievement and I.Q. between populations 
which differ on socioeconomic, ethnic, or racial descriptions. 

Jensen's critics d\» not propose alternative values for the heri- 
tabilitv of intelligence but remain agnostic about the causes for 
d i f ferences . 

Jensen reports numerous studies of manipulating the environment, 
which achieved tempo ra ry effects. While somewhat imprer sive , the final 
scores reported were still within or near the standard error of estimate 
based upon average heritability in most cases. What Jensen is saying 
is that envi ronmenta 1 nan inulat ion can acccunt for only a small portion 
of 1*}. variance and that part of the accountable portion is outside 
the province of society's conception of educational practice (e.g. 
nutrition, number of cl.il dren per family, amount of individual attention). 
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Jtnsen cites evidence from several sources to define the relation- 
ship between I.Q. and socioeconomic status. Jensen sees this relation- 
ship as associative, and not causative. Socioeconomic status is 
merely a proxy measure of I.Q., he believes. 

Intelligence is defined by Jensen as only one aspect of what he 
calls mental ability. He then reports data to show that intelligence 
so m easured is substantially lower among blacks than among whites. 
Needless to say, he meets attack from his critics, but they offer 
no really helpful comments and leave the issue unresolved. 

The majority agree that there is some genetic basis for intelli- 
gence, and we must face the issue of individual differences with the 
knowledge that everyone can not be expected to perform at the same 
level. Each individual must be given the opportunity to develop his 
potential to its fulfillment. The goal of education becomes diversity 
of opportunity , with maximum assistance to each individual to find 
for himself his optimum fulfillment. Jensen believes that there is 
potentially much more that can be done to improve school performance 
through environmental means than through the changing of I.Q. per se. 
The focus should be upon achievement rather than changes in intelli- 
gence . 

The issue becomes one of allowing Jensen to continue his work in 
helping mankind understand better the role of genetics and the kind of 
learning ability that may be genetically determined. 
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Discussion 



Moderator: Dr. Charles R. Dolan 



Associate Professor 
Counselor Education 



University of Bridgeport, 



Connec t i cut 



Reactors: Dr. John A. Finger, Jr. 



Jarvis D. Jones 
Assistant Professor of 



Director, Educational 



Services Center 
Rhode Island College 



Secondary Education 
Rhode Island College 



Dr. Robert W. Stoughton 
President, AMEG 
Chief, Bureau of Pupil 
Services 

Connecticut State Depart- 
ment of Education 



There is enough intelligence in nearly all of human! tv to handle most 
of the tasks to which we have to address ourselves. For example, 
everyone shojld b 2 taught to handle the number system, to read, etc. 
T^ose who do not achieve this level have what be calls a physiological 
i; . i rment . 

There is a wide range of abilities and talent ■< in many different 
areas, and well over 5 n !' of the population is at the 1 p of the scale 
in some factor of intelligence. Ve have individual d i 1 ioroiioes but 
they are not necessarily limiting to people. Ve can expect people to 
accomplish successful lv general operations within sinioty and very .00 11 
in a specific area which is suitable to the individual. 
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Dr. John A. Finger: We cannot settle the issue of intelligence and the 

heritability of intelligence. We cannot say how much gain we can expect 
from the best compensatory education program, because these programs have 
not been effective, and we should have been able to make this prediction. 
Compensatory education programs must be improved and we have to try to 
determine what result ^ we should obtain from good compensatory programs. 

It is a question of discovering where the effective ones have been, and 
then studying them. 

We tended to classify by race rather than socioeconomic differences 
and we need to examine our whole way of looking at this problem. We assume 
that race is the only way to classify, rather than realizing that socioecon- 
omic reasoning has the solution. Environment can have such a major influence 
on some children while not on others. 

Dr, Robert Stoughton: Heredity may be the more important factor in intelli- 

gence which is not the same as mental ability. It may be more important than 
environmentalists assume and there may be racial differences in mental char- 
acteristics. Through factors other than intelligence which affect achieve- 
ment and success, we can do much to improve performance through environmental 
means . 

The important point Jensen was emphasizing is to treat each person 
an individual; that variables such as social class, race, national orig 
are correlated so imperfectly with any of the valid criteria on which 
education or employment decisions should be made that they are irrele'. 
as bases for dealing with individuals. 

Socioeconomic status and environmental forces can depress or elew.t 
an individual's ability to advance. Jensen doubts that educational inte. 
vention will significantly affect intelligence, as he defines intelligci 
however, educational intervention can affect achievement. Intelligence 
an irrelevant hurdle; there are other evidences of capacities to perfo: 

The. term I.Q. is emotionally charged, Jensen's recognition of oLlu 
than mental factors in success gets lost by laymen, who insist on bel .< 
the I.Q. is unchangeable. High heritability does not mean that environ 
cannot be important - it means it has not been imporcant. 

Using tests as prediction are merely excuses for human failure, 
help us determine the intervention we should use. 

Question from floor - Whit kinds of interventions will succeed? 

Comments from floor - Personalities of people involved in education art 

important than structured programs. Our percept i 
of youngsters in essence determine their behavioi . 
is important to be concerned with the cognitive 
affective elements of persons. People are the r? 
important elements of learning and giowth, rath* i 
structured programs. 
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STATEMENT OF PURPOSE 



NEW ENGLAND ASSOCIATION FOR MEASUREMENT AND EVALUATION IN GUIDANCE 



New England AMEG is an affiliate of the Association of Measurement and 
Evaluation in Guidance, a division of the American Personnel and Guidance 
Association. The primary purpose of this organization is to provide lead- 
ership in educational measurement and evaluation in New England. Further 
purposes indicated in the By-Laws are to: 

a. provide a forum for the discussion of problems related to 
measurement and evaluation within the guidance area. 

b. identi f v problems and concerns relating to the use of tests 
and other evaluative devices in the personnel and guidance 
area . 

c. stimulate research '-elating to tests and their use in guidance. 

d. promote the effective training of personnel in the use and 
interpretation of measurement and evaluation devices in 
guidance and personnel work. 



NEW ENGLAND A M E G / Officers, 1969-70 

President: Prof. Francis E. Dunn, Director of Educational Measurume.it, 

Brown University 

President -El f.ct : Mr. Richard P. Tardy, Director of Elementary School 

Guidance, Concord Union School District, Concord, N.il. 

Su^re Uarv-l^rejis ur_e r : Prof. Vincent J, Worden, Bridgewater, Mass., State 

College 

Membership: Dr. Charles R. Lolan, Associate Professor, Counselor Education, 

Colege of Education, University of Bridgeport, Bridgeport, Conn. 0660.? 

Pul 1 i cat ions Chairman: Dr. Rebft W. Lead, Associate Professor, Couhs^Im' 

Education, College of Education, Northeastern University . Boston, Ma^s. 02 U 
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